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L THE IMAGE 

I. An imafit is a spatial rcprcscjiution of an object, 
3 iwo-dimcnslonal or ibrcc^irocnsional scene, or 
another image- It can be real or virtual as in opticj- 
In computer vision, "image" usually means rceorded 
image such »s a video image, digital image, or 
picture. U may tw abstractly thought of as a con- 
tinuous function / of two variaW« defined on some 
bounded and usually rectangular region of a plane, 
the value of the image located at spatial coordinates 
(r, c) is denoted by /(r. c). For optic or photographic 
sensors, /(r, c) is typically proportional to the radiant 
catergy received in the electromagnetic band to which 
the sensor or detector is sensitive In a small area 
around (r, e). For range finder sensors, /(r, c) is a 
funciion of the line of sight distance from {t. c) to wi 
object in the three-dimensional world. For a tactile 
sensor, /(r, c) is proportional to the amount that the 
surface at and around {r.c) deforms the swisor. 
When the image is a map, /(r, c) is an index or 
svmbol associated with some category such as a 
color, a thematic land use category, a soil type, or a 
rock type. A recorded image may be in photographic 
format, video signal format, or digiui forniai. 

Z. A wrfep mwg/ is an image in clceironic signal 
formal capable of being displayed on a cathode ray 
lube screen or monitor. The video aignal can be 
generated from devices like a CCD camera, a 
vidicon. a nvlng spot scanner, a tactile sensor, a 
range sensor, or a frame buffer driving a digital to 
analog converter. Video images have two common 
fonnais. In the frame tormat. the video signal Itself 
is a sequence of signals, the fth signal representing 
the Ah line of the Imige- The iih signal is separated 
from the (f + 1 \sx sigiial by p horizontal sync or pulae. 
Each video fmme is sejparated from the next video 
frame by a vertical sync pulse. In the interlaced 
format, the ^ideo signal is divided into two fields. 
The first field contains all the odd numbered lines 
and the second field contains all the even numbered 
lines. As in the frame formal, the ith line of the fieW 
is its ith signal, and it is separated from next line of 
the field by a horizontal sync pulse. Successive fields 
are separated by vertical sync pulses. 

3. The grpy leoeL grow ^hade, gray tone, gray four 
intmity, image intensity, image (Uruiiy. hrightnets, 
or image tmlue is a numbw or value assigned to a 



position on an ixnage. For optic Of photographic 
sensors, the image intensity ai (r.c) is proportional 
to the integrated output, refketancc. or trans- 
mittance of a small area. usuaUy called a resolution 
cell or pixel, centered on the position (r.c). Its 
value can be related to trareunittancc. rcflectanee. a 
coordinate of the tristinaulus. ICl. YIO, or RGB 
color coordinate system, brightness, radiance, lum- 
inance, density, voltage* or current. 

4. Resolution is a generic term which describes 
how well a system, proccs*. component, material, or 
image can reproduce an isolated object consistmg of 
separate closely spaced objects or lines. The limiting 
raoUttion. rtsolutSon limit or spaHal resoiutton is 
described in terms of the smallest dimension of the 
target or object that can just be discriminated or 
observed. Rcsoloticn may be a function of object 
contrast and spatial position as well as element shape 
(single point, number of points in a cluster, 
continuum, or liiic etc.). 

5. Aresolutioiteea is the smallest most elementary 
areal constituent having an associated image inten- 
sity in a digital Image- A resolution cell is referenced 
by its spatial coordinates which arc the center coor- 
dbates of its area. The resolution cell or spatial 
formations of resolution eeU constitute the basic umi 
for low level processing of digital image data. Reso- 
lution cells usually have areas which are square, 
rectangular* or hexagonal. 

6. Aeuumix is a measure of the sharpness of edges 
in a photograph or image H is defined for any edge 
by the average squared rate of change of the image 
intensity across the edge divided by the total image 
intensity difference frt>m one side of the edge to the 
other side of the edge. 

7. The contrast of an object against its background 
can be measured by: (1) its contrast ratio, which is 
the ratio between the higher of object transmiitaiicc 
pr background ttansmittance to the lower of object 
transmittancc or background irdnsmittaocc; (2) its 
confMil different, which is ihc difference between 
the higher density of object Or background to the 
lower density of object or background; f 3) its contrast 
modtiiatitHt. which is the difference between the 
darker of object or background image intensity and 
the lighter of the two divided by the sum of object 
image Intensity and background image intcn^ty. 

8. A pixtK picture element^ or pet is a pair whose 
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first member i» a rcsolmion wll or irow. column) 
spaiial position and wh<nic Mrcond member i> chc 
image inteiwity vulu« or vcaor of image valu«» 
a&sodated with the 5paiial position. 

V. A dOiW. !ihori for vi->lumc element, is an ord- 
crrd pair whose finit component is a (row, eclumn. 
slice) location of a volume rectaniiular parallcpipcd 
and whose "^econd compon€ni is the vector of proper* 
tics in the rccianjular parallelpiped volume. 

10. Art etigifi, short for edge clement. » a iriplctt 
whose fitiit component is the (row. column) location 
of a pixeL whose secoiid component is the position 
and orientation of an edge running through the pixel, 
and whose third cDW<>»«n< >^ strength of the 
edge. 

tl. Rosier scan order refers to the sequence of 
pixel locations obtained by scanning the spatial 
dcrmuirt of an image in a left to right scan of each 
image row with ihe rows taken in a top to bottom 
ordering. Frame format video images arc Imagefi 
scanned in raster scan order. 
• 12. A range image is an image in which each pixel 
value is n function of the distance between ihe pixel 
and the object surface patch imaged on the pixel* 
Depending on the sensor and preprocessinj used to 
create the range image, the distance can be the 
distance between the image plane and the ranged 
surface patch* the line of sight distance between the 
pixel and its cdrrespondlng ranged surface patch or 
some function of these <ti&iances and the pixel's 
position. 

13. A digftaf image, digtiized image, or di^ifd/ 
picture funaion Is an image in digital format and is 
obiaitied by partitioning the area of the image into 
a finite twQKlixnensioiial array of small uniformly 
shaped mucually exclusive regions called resohiftion 
celts and assigning a representative image vahie to 
each such spatial region. A digital image may be 
abstractly thought of as a function whose domain i« 
the finite twodimensional set of resolution cells and 
whr.se range is the set of possible image intensities. 

l-t. Rangel is the range data clement produced by 
a range sensor. It Is a pair whose first member is 
a row column spatial position and whose second 
member Is the range value or a vector whose first 
component is the range value and whose second 
component is the image intensity value. 

15. A depth rrtap or range map i> a digital range 
image in which the range value in each pixel's posi- 
tion b the distance between the Image plane and the 
ranged surface patch carrespoflding to the pbel. 

L6. An orienWtiOH map IS a digiul image in which 
each pixel contahts the 3D orientation vector of the 
normal to the 3D surCaci patdi corresponding to the 
pixel position. 

17. A multi-image set or mutti'band image is a set 
of registered images each related to the same subject 
but taken at different times* from different positions, 
with different lighting, with different Benson, at dif- 
ferent electromagnetic frequencies, with different 



polarizations, or from different licctions of the 
subject. Although tnere is a high degree of infor- 
mation redundancy between images in a mattl-lmage 
set. each image usually has some informaiiott not 
available in any one of or combination of the other 
images in the set. If the multi-ima ge set has images, 
then each resolution cell is associated with an S- 
tuple of image values. 

18. A muUi'speciral image is a multi-band image 
in which each band is an image taken at the same 
lime, but sensitive in a different part of the elec- 
tromagnetic spectrum. 

19. A time varying irnage, midti-ttmporat image, 
dynamic imagery, or image time sequence \s a multi- 
image set in which each successive image in the set 
is taken of the same scene at a successive time. 
Between successive snapshots, the objeds in the 
scene may move or change and the sensor may move. 

20. A binary image is an image in which each pixel 
takes either the value zero or the value one, 

21. A gray scale image or a gray level image is an, 
image in which each pixel has a value in a range 
larger than just 0 or 1. Gray scale imi^es lypicalW 
have values in the range 0 to 63. 0 to 2S5. or 0 to 1Q23 
corresponding to 6 bii« B bit. or 10 bit diptizattons. 

22. A symbolic Image is an image in which the 
value of each pixel is an index or symbol. 

23. A histogram or image histogram ts a function 
h defined on the set of image intensity values tO the 
non-negative Integers. The value hik) is given by the 
number of pixels in the image having image intensity 
k. For images having a large gray tone nnge, the 
image will often be quantized before being his- 
togrammed or will be quantized on the fly during the 
histogramming process. 

2. niOTO>tuntY A^a> iuxminaTION 

24. tuirlinoitf flux is radiant power evaluated 
according to its capacity to produce visual sensation. 
Uaninous intensify in a given direction is measured 
in tetms of luminous Ilux per stenidian. The unit of 
luminous intensity is the condeta. The luminance of 

* a bl»cfc body radiator at the temperature of sol- 
idification of platinum ts 6U candelas per square 
centimeter. The unit of luminous flux is the lumen. 
The luminous flux emitted by a uniform point light 
source of luminous intensity of one candeU in one 
stera<yan solid angle is one ttumn. 

25. The iliumiruition at a point on a surface is the 
luminous Dux incident on an infinitesimal clement of 
the surface centred at tha gfycn point divided by area 
of the surface elemctit. The unit of iUumination is 
the ituc or meter-candle. The lux is equal to one 
lumen per square meter. Another unit of illumi- 
nation is the /oof cfffiiffe and it is equal to one lumen 
per square foot, the tlluminaiion at a point on a 
surface due to a point source of light Is proportional 
to the luminous mtenstty of the source in the direc- 
tion of the surface point and to the cosine of the 
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angle beiween this direction and the surface normiil 
direction. It is inversely proportional to the square 
of the distance between the surface point and the 
source* 

26. The iUuminance in a given direction at a surface 
point ts the lumirioiis Imcnsiiy in that direction of an 
infinitciimal surface clement conuiining the given 
point divided by the area of the orthogonal pro- 
jcciion of the el'cmeni on a plane perpend iculur lo 
the given direction. 

27. The ratliancr of an object is a measure of the 
power per unit foreshortened surface area per unit 
Mild anjile radiated or reflected by ihc object about 
a specified direction. Radiance can be a function of 
the ^-iewing angle and the spectmi wjivelength and 
bandwidth. 

2)}. The radiant intensity of a point object » • 
measure ot the radiant power per stcradian radiated 
or rcflcaed by the objecu Radiant intensity can be 
a function of the viewing an^e and the spearal 
wavelength and bandwidth. 

29. irradiance \> the power per unit area of radiant 
energy incident on a surface. 
' 30. The refl€aanct, the rcfitaion eoeffideni, or 
Ihe bidirectional reflectancr distribution function of a 
surface is the ratio of the radiant power per unit area 
reflected by the surface to the radiant power per unit 
area incident on the surface- The reflectance can be 
a function of the incident angle of the radiance, 
the viewing angle of the sensor, and the spectral 
wavelen^h and bandwidth. 

31. A rtflcctanct image or refiectant* map is a 
digital ima{ie in which the value in each pixel's posi- 
tion Is proportional to the reflectance of ihe surface 
patch imaged at the pixel's position for a given illumi- 
nation and viewing direction* 

32. A Lamhertian surface is a unifonnly diffusing 
surface. It appears as a matt surface and it has a 
reflectance function which is a constant. The rcflec* 
lance function of a LambCTtian surface docs not 
depend an the viewing angle and. therefore, a planar 
surface having a Lambcrtian reflectance appears 
equally bright from all viewing angles. For a Lam- 
bertian surface, the luminous intensity- per unit area 
in a given direction varies as the cosine of the angle 
between the direction and the surface nonnal diree^ 
lion, 

33. Backlighting refers to an illumination arrange- 
mem in which the light source is on the opposite side 
of the object from the camera- Backlighting tends to 
produce images which are black and white silhou* 
eites. 

34. Frontti$hiing refers to an illuminarion arrange- 
mrni in which the light source i» on the same side of 
the object as the camera. 

35. Ambient light refers to the light which is 
present in the erivironment around a machine vision 
system and which is generated from sources outside 
of the svsiem. From the point of view of the machine 
vision system, ambient light is unplanned Kght which 



might adversely affect the image processing- Care is 
usually taken to minimize its effect. , 

36. The r. b chromoticity coordinates of a multl- 
spectral pixel, where red brightness is R. green 
brightness is C and blue brightness is B. is given by 

R 
C 
B 

^"/? + c + fl* 

37. The //, S htie saxuration coordinates of a multi- 
spectrat pixel whose chromaitcity coordinatoi m r, 
g, b is given by 

H=\ if 

l360-e b>g 

where 

lr-i(-b 

e - arceos ^^j^^ « i)^ + - i)3 + (i. - 

5=1-3 min{r. g. b). 

38. The YIQ coordinate used in NTSC color TV 
transmissions is related to the RGB coordinates by 
the following linear transformation: 

• 0.587 OAMKJR^ 

=» I 0.596 -0.274 -a322j|Gj. 

\0.2il -0.523 0.312/ W 

3. niCTTDcilAMMCTBY 

39- Analytic phoiogntmmetry refers to the analytic 
mathematical techniques which permit the inference 
iQ geometric relations between points and lines in 
the two-dimensional perspective projection ima^ 
space and the three-dimensional object space. 

40. Digisal photogrammetry refers to the computer 
processing of perspective projection digital images 
with analytic photogrammetry techniques as well as 
other computer techniques for the automatic inter- 
pretation of scene or image content, 

41. Relative ortentation in analytic pboiogram- 
merry i» the relative position and orientation of one 
common reference frame with respect to another. 
When two common reference frames are in known 
relative ohentatiDn. the rays emanating from the 
same object point located on each camera's image 
will intersect exactly at a point in 3D space. 

42. The exterior orientation or outer arieruation 
rcfets to the position and orientation of a camera 
reference frame with respect to a world reference 
frame. 

43. Absolute orientation in analytic photogram^ 
metry is the rotation and translation transform- 
ation(s) by which one or more camera reference 
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fratne(s) can be made to correspond to a worid 
reference frame. 

44. The opric axis or prin<:ipaJ axis is ihe straight 
line which pasie* through the centers of curvature* 
of the lens surfaces. 

45. The principal point is that poini on the image 
which is the intersection of the image plane with the 
optic axis. 

46. The cmtr of ptrsptctiuity of a pcnpcciive 
projection is the common point where an rays meet. 

47. The principal distance is the distance between 
tlie center of pcrspcctiviiy and the imnge projection 
plane. For n fixed image, it is sometimes called the 
cameiQ cansiani or Oauisian focal length. 

48. The inner oritntaiion or internal orientoHon is 
given by the triple (un^oo*/) b the 
position of the principai point in the mcasuremeiit 
image plane coordinate system and/i* the principal 
distance. Inner oiicntation may also include the val- 
ues of the free paramctcfs which describe the lens 
distortion. 

49. A perspective projection is defined in terms of 
a projection plane and, a center of perspcctiviiy. 
Imaging sensors whose ideal model is the pinhole 
camera generate perspective projection images. 
There are three commonly used frameworks for 
defining the relationship between a 3D point and lis 
20 perspective projection. All take the projection 
plane to be perpendicular to the :-axis. In the first 
framework, the center of pcrspectivity is taken to be 
the origin and the projection plane is a distanee / 
from the origin on the positive r-axis- In this case 
the projection [P.^P^of the point {x. y. s) is given 
by 

pJ^P^^ 

In the second framework, the center of pcrspectivity 
is taken to be (0*0. -f) and the projection plane 
passes through the origin. In this case the projection 
CP.. P,) of the point (X. y. r), r > 0. is given by 

in the third framework, the center of pcrspectivity 
is taken to be (0, 0. f) and the projection plane passes 
through the origin- In this case the projection {Pm^ 
of the point (x.y, s < 0» Is given by 

fx ^ _ fy 



Pm * 



50, A pantUei or orthographic projection onto a 
plane perpendicular to the z-«xis of a point ix,y^ z) 
produces the projected (P.* Py) defined by 

P^^sx.Py^sy 

where j is the scale factor of the projection. 

51- The paroilax is the observed positional dif- 
ference of a projected 3D point on a pair of 2D 



perspective images. The difference in position is 
caused by a shift in the position of the perspective 
centers aiul optical axis orientation. That portion of 
the porallAx in the direction of the x-axis is callett 
Che X'parallax, That portion of the paralto in the 
direction of the v-axis is called the y-parailax* For a 
pair of stereo images where the line joining the 
centers of pcrspectivity is parallel to the x-axis. the 
parallax will be entirely in the direction of the x- 
axis when the two image planes ate iit the same 
orientation. Should one image plane be rilted with 
respect to the other, the y-paralJax will not be zero. 

52. A t>anishins point is iheypoini in the 2D per* 
spectivc projection image pMe where a system of 
3D parallel lines converge- TTic vanishing points of 
all systems of 3D parallel lines parallel to a given 
plane will lie along a corresponding line in the ID 
perspective projection image plane called the van- 
ishing line for the given plane. 

4. 1MACCOPERAT01LS 

53. An jffMffc operator, image transform, or image 
transform Operator is a function which takes an image 
for its input and produces an Image for its output. 
The domain of a minsfOTm operator is often called 
the spatial or space domain. The range of the trans- 
form operator is often called the transform dornam. 
Some image transform operators have spatial and 
transform domains of entirely different geometry or 
character, the image in the spatial domain may 
appear entirely different from and have a different 
interpretarion from the image in the transform 
domain. Specific examples of these kinds of image 
transfonns indude Fourier. Sine, Cosine, Slam, 
Hear* Hadamar^* Mellin. Karhuncn-Uicve, and 
Hough transforms. Image operators which have spa- 
tial and transform domains of similar geometry or 
character include point operators, neighborhood 
operators, and spatial filters. 

. 5. roiNT OPCftATOBS 

54. A paint operator is an image operator in which 
the output image value at each pixel position depends 
only on the input image value at the ccrrresponding 
ptxd position. 

55. Thresholdins ison image point operation which 
piodtices a binary image from a gray scale image. A 
binary one is produced on the gutpui image when- 
ever a pixel value on the input Image is above □ 
specified minimum threshold level. A binary zero is 
produced otherwise. Alternatively thresholding can 
produce a binary one on the output image whenever 
a pixel value on the input image is below a specified 
maximum threshold level. A binary ieto is produced 
otherwise, 

56. Level slicing or density slicing h a point opera- 
tion which employs two threshoWs and produces a 
binary image . A binary one is produced on the output 
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( imsge wherever a pixel value on the input image 

|tc& between the speciried mmimum and maxinrnm 
threshold levels. A binary tefo is produced othcr- 
«ue. 

57. MuM'ltvei ihmholdutg is a pom operator 
cmjrioying two or more tbrcsholds. Pixel values 

• whidi are in the interval between two &ueeessivc 

• threshold values are assigned an index nssociated 
with the interval. 

58. Contraitstmching tefm to any monotonwally 
increasing point operator whose effect is to increase 
or enhance the visibility of an image's detail. 

59. Quanri^ins ^ a monoionically increasing point 
operator by which each image intensity v;iluc in a 
digital image is assigned a new value frttm a given 
finite SCI of quantized values. The quantized image 
has fewer distinci gray IcvcU but may make better 
use of the dynamic range. Thus quantizing aitcn 
enhances the image's appearance. There are four 
often used methods of quantiiting: equal interval 
quaniiziog* equal probability quantizing, minimum 
variancc quantizmg. and histogram hypcrbolization. 
In each method, the r»nge of image values from 
the maximum to the minimum value is divided into 
contiguous intervals and each image value is assigned 
either t he mean ^Tilue of the quantized class to wiikh 
it belongs or the index of the quanti^ class to which 
It bckmg;^- 

(a) 60. In tquol intervai ijuantizing or /m«ir quan- 
(isiJig, the range of image values from maximum 
value to minimum value is divided into contiguous 
inieivals each of equal length, and each image 
value is assigned to the quantized class which 
corresponds to the interval within which it lies; 

(b) 61. In tqua( probabilify quaitiiiing, the range 
cf image values is divided into contiguous intervals 
such that after the image values are assigned to 
their quantized class there is an equal frequency 
of occurrence for each quantized value in the 
quantized digital image: equal probability quan- 
tizing b sometimes referred to as or hixtogmm 
tquaUzadon- 

|c>$2. In minimum variance quannzing. the range 
of image values is divided into contiguous intervals 
*uch that the weighted sum of the variance* of the 
quantized intervals is minimized. The weights are 
qsualiy Chosen to be quantized class probabilities 
which arc computed as the proportional areas on 
the image which have valves in the quantizing 
intervals. 

(d) 63. In histogram hypfrbalizatiott quantizing^ 
the range of image values is divided into con- 
tiguous intervals and each image value is assigned 
to the mean of its quantized dass. The division is 
done in such a way that the quantized image has 
. a uniform perceived brightness. Histogram hyper- 
bolization takes into account the nonlinearity of 
the human eye brain combination. 
64. Masking is a point operator applied to a two- 
band image. One imagii band i& a binaiy image B 



and is called the mask image band. The second image 
band / is called the image to be masked. Masking 
produces a resulting image J whose take the 
value zeio wherever the mask image has value zem 
and whose pixels take the value of the image / 
wherever the mask image has value one. That is, 
fO ifB(r,c)=0 



65. Change defection ia the procejss by which two 
registered images may be compared, pixel by pixel, 
and a binary' one value given to the output pixel 
whenever corresponding pixels on the Input images 
have significantly different enough gray levels. Cor- 
responding pixels on the input images which do not 
have signifieatttly different enough gray levels gen- 
er^e a binary ^ro value on the output image. A 
change detection operator Is a point operator. 

Sr ATlALOPSRATinS 

66. Tmto^dimensiOftai signal processing refeis lo 
that area of image processing in which the one* 
dimensional signal processing techniques of noise 
filtering, restoration, data compression, and detec- 
tion have been generalized to two dimensions and 
therebv made applicable to image data. 

67. A neighborhood operator is an image operator 
in which the output image value at each pixel position 
depends only on the input image values in a neigh* 
Iwrhood containing or sunounding the correspond- 
ing input pixel position, 

68. A spatial filter is an image operator in whieh 
the spatial and transform domain have similar geom- 
etries and in which the image output value at each 
pixel depends on more than one pixel value in die 
input image. Usually, but not always, the image out- 
put vahic has its highest dependence on the image 
input values in some ncighborht>od centered in the 
corresponding pixel in the input image. 

69. A linear spatial filter is a spatial filter for which 
the image intensity at coordinates (r» c) in the output 
image is some weighted average or Uncar com- 
bination of the image intensities located in a par- 
ticular spatial pattern around coordinates (r.c) of 
the input image. A linear spatial filter is often used 
to change the spatial frequency characteristics of die 
image. For example, a linear spaital fiher which 
emphasizes high spatial frequencies will tend to 
sharpen the edges in an image. A linear spatial filler 
which emphi»iZBS low spatial frequencies will tend 
to blur the image and reduee salt and pepper noise. 
When the purpose of the filter is to enhance neigh- 
borhoods having certain shapes, the operation is 
sometimes called mask matching. 

70. The kernel of a linear spatial filter is a function 
defined on the domain of the spatial pattern of the 
filter and whose value at each pixel of the domain is 
the weight or coefficient of the linear combination 
which defines the spatial linear filter. 
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71. A box fitter is » Hnear spatial smoothing filter 
in which each pixel in the filtered imagE ii the equally 
weighted average ot ihe pixels in 9 rectangular win- 
dow centered at its spatial posuiion in the input 

ima((e. 

72. The Causiicn fitttr is a linear spatial smoothing 
filter whose kernel i$ given by the two-dimensional 
Gaussian 



as ai'' 



Filtering an imace with a Caussian Alter will smooth 
the image. 

73. Convolving an image / with a kernel k having 
suppoit or domain K produces a convolved image, 
denoted by / * Jt. which is defmed by 

(/♦ik)(r,f)= S l{r-Lc-nkUJl 
ii.il e«r 

Convolution is a linear operator. 

74. A two-dimensional filleting operation is called 
separable if the convolution can be decomposed into 
two !(uccc!&^ve one-dimensional convolutions, one 
convolution operating on the image row by row 
and the second convolution operating on the innage 
column by column. 

75. Correlating an image / with a kernel k having 
support or domain K produces a correlated image J 
defined by 

Correlation is a linear operator. 

76. The discrat Fourier transfom / of a digital 
image / represents the image in terms of a linear 
combination of complex exponentials. The Fourier 
transform / is defined by 

r^tt i--g 

At*V« is the coefficient of the complex exponential 

r^'T* T") in the linear eombinatiop representing / 
as can immecUately be seen from the corresponding 
relation 

/(r.e)- 2 2 i{H'M*^f)r^'^~"rl 

which is called the in uerse discrete Fourier transform. 
The variables and bave the interpretation of 
being row and cobmn spatia! frtqueneits, 

77. A high passfilur is a linear spatial filter which 
attenuates the low spatial frequencies of an image 
and accentuates the high spatial frcqueneies of an 
image. It is typically used to enhance small details, 
edges, and lines. 

. 78. A pasM filter b a linear spatial filter which 
attenuates the high spatial frequencies of an image 
and accemuates the low spatial frequencies of Art 



image. It is typically used to supress smalt undesired 
details, eliminate noise, cnhaoee eoai>e im^ fea- 
tures, or smooth the image. 

79. A band pass filter is a linear spatial filter which 
attenuates those spatial frequencies outside (he band 
and accentuates those spatial frequencies wiihln the 
band. It is typically used to enhance details of the 
Itnagc whose spatial size characterbtics ate related 
to the spatial frequencies within the band. 

80. A pyramid or image pyramid is a sequence of 
copies of an image in wMch both sample density and 
resolution aredecreascd in regular steps. The bottom 
level of the pyramid Is the original image. Each 
jiueceisive level » obtained from the previous level by 
a filtering operator followed by a sampling operator. 

In the Gaussian image pyramid, the rcsohition is 
decreased by successive eonvolutioits of the image at 
the previous level of the pyramid with a Gaussian- 
like Icernel. After the low pass Gaussian convol- 
utions, the sample density b typically decreased by 
sampling every other piuL 

In the morphological image pyramid, each suc- 
cessive level is obtained by an opening and closing 
operation on the ' preWous level followed by 
sampling. 

In the Lapladan image pyramids eodi successive 
layer is Obtained by ulcmg the Lapladan of the 
corresponding level on the Gaussian pyramid. The 
Inaplaeian eonvohition kernel here is typically 
defined as the kernel obtained by taking the Lapla- 
dan of a Gaussian haying an appropriately ehoscn 
value for its standard dcviation- 

BL An edge operator or step edge operator is a 
neighborhood operation which dete rmnics the extent 
to which each pixcrs netghborh*^ can be par- 
titioned by a simple arc passing through the pixel 
where pixels in the neighborhood on one side of the 
are have one predominant value and pixels in the 
neighborhood on the other side of the arc have a 
different predominant value. Some edge operators 
can also produce a direction which is the pre- 
dominant tangent direction of the arc as it passes 
through the pixel. 

There are four classes of edge operatore; gradUnt 
operators^ Laphcmn operators, zero-crossitig oper- 
ators^ and morphologic edge operators. The gradient 
operators compute some quantity related to the msg- 
nitude of the slope of the underlying image gray tone 
intensity surface of which the observed image pixel 
values are noisy discrctized sample. The Lapladan 
operators oompvte some quantity related to the 
Lapladan of the underlying image gray tone intensity 
surface. The zcrt>-ctossing operators determine 
wiicthcr or not the digital Lapladan or the estimated 
second direction dcrivaiive has a zero<ro&sing within 
the pixeL The morphologic edge operators compute 
a quantity related to the residues of an erosion and/ 
or dilation operation. 

82. An edge image Is an image in which each pixel 
b labelled as "edge'' or "non-edge**- In addition to 
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this W labeling, pixeb in an cdgft image may carry 
addiuonal informaUon such jis edge dirccnon. edge 
contrast, or edge strength- 

83. Edg€ linking refers to Oic process by which 
neighboring edge Ubeled pixels ^^^^^^^''''^ 
lo constitute a chain or sequence of edge p«ei5. 

g4. Boundary detecuon of bwndary dflmtaaan 
refers lo anv prwx« which determines 3 chain of 
pUds separating one image region from a neign- 
bortnc image region- . 

83. An occ/nrfirtR erfpir is an image «^ge which 
arises from a range or depth dlsconiinuuy. This 
typically happens where one object surface projects 
to a pixr! on one side of the edge and another obje^ 
surface which is some distance behind the fim object 
sorface projects to apixcl on the other «^ofthe 
edge. Step edges in depth maps are always occluding 

^IT a pair of straight edges are said to be tf«n- 
panUel if there are no edges between Them and the 
edges have opposite contrast. ^«„in 
57. Homomorphic filtering is a filtcnng procc$» m 
which die filter is applied to the toganthrn of the 
image and the output image is obtained by 

exponentiating the filtered logarithm imagj. ^ 

A m€4ian filter is » non-Unear neighborhood 
Image smoothing spatial ftUer in whkh the value of 
an wtpul pixel is the median value of all the input 
pixels in the supporting ^^^^'^^/^^^ 'l!^^^^^ 
about the given pixel's position. Median filters are 
Q^ed 10 smooth and remove noise from i^^gw. 

89, Imas^ imoothing refers to any spatial fihcnng 
producing an output image which spatially simplifies 
and approximates ihc input image. Image Rmoothmg 
jupprwses smaU image details and enhances hirge or 
coanie image stnicturcs- . i.. u 

90. A icalt spccr image is an image in which each 

pixcPs value is a function indicating for each standard 

deviation o the value at the pixel's position of the 

convolution of the image with a Gaussian kernel 

having standard deviation a, , . 

91 SM/*5;Kicc:rfn«iiinr refers to that analysis of 

» »calc space image m which each Pi^cl's val^ is a 
function specifving for each possible standard dcvi- 
ation o whether the pixel comams a zen> crossmg of 
some combination of a fnted order of spatial partial 
derivatives evaluated at the pixel's position. 



position. Tlie ttnicturing element of a morphologic 
operator has a tolc in morphology exactly analogous 
to the role of the kernel in a convolution operation. 

94. Ottering an image / by a structuring element s 
haviiig support or domain 5 produces a <matcd image 

denoted by 70* which is defined by 



ryej)Cr,c)* nKix</(r-i.c-j) + i(M)K 

It. j)6S ^ . 

Dilatmg b a commutative, associative, translation 
invariuni. and increasing operation. Dilating is the 
dual operation to eroding. 

95. Eroding an Image / b>- a strwturing element s 
having support or domain S produce on eroded 
image denoted by IBs which is defined by 



mm \I{r^Le + j)-s{Lnl 
iMieS 



7. MORPHOLOGIC OPERATORS 



92. MalHemaiical morphology refers to an area 
of image processing conccmed with the analysis or 
Shape. The basic morphologic operalions consist of 
dilating, eroding, opening, and closing an Image with 
a stniciuring element. ... ^ 

93 TTie iffMCfurt/ig element of a morphologic oper- 
ator is a function defined on the domain of the spatial 
panemof the morphologic operatorandwhoscv«lue 

at cadi pixel of the domain Is the weight or coefficient 
employed by the morphologic operator at that pixel 



Eroding is a translaiion invariant and increasing 
operation. It is the dual operation to dilating. 

96- Openins an image I with a stmctunng clcineiit 
, produces an opened image denoted by / O J which 
IS defined by 

Opcning is an increasing, anti-extensive, and idem- 
poiem operation- It is the dual operation to dosing. 
Opening an image with a disk shaped struciunng 
clcmem smooths the contour, breaks narrow hah- 
muses. and eUminaies islands and eapcs smaller m 
size or width than the disk structuring elemcni. 

97. Gosing an image / with a sinicturlng dement 
5 produces a dosed hnage denoted by /•« which ts 
defined, by 

aosing is an increaang. extensive, and idempoient 
operation. It is the dual operation to opcnmg. Qos- 
iSg an image with a disk shaped structuring element 
smooths the comours, fuses narrow breaks and long 
thin gulfe. climitwtes holes smaller in size than the 
disk structrmg element and Alls gaps on the contou r- 

98. A thinning operator is a symbolic image nctgn- 
borhood operator which deletes, in some symmeinc 
way. all die interior border pixels of a region wh,ch 
do not disconnect the region. Successive appUcations 
of a thinning operator reduces a region to a set of 
arcs wlddieonstltute a ^ie/eroii of the region- 

99. A thickening QpetQtor is a symbolic image 
neighborhood operator which in some symmctnc 
way aggregates all background pixels near enough 
to a re^on into the region. 

I. HOVGH TRAWFORM 

100. The ifwcn^r^ Rcdon transform : 0 l?. * ) 
of a function /: X-- [0, x) relative to a functional 
form FxX x (?— [0, is defined by 

UeJriH<.«i-<M 

101. -me Hou^h wmsform «:a-|0.«) of a 
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^ functipn iiX-^\0.^) relative ip 9 functional form 

FtX^ Q-t-lO. »). where itt is a panition of the 
psiramctcr space Q, n defined by 

When / has the form /(jt) = I. tor every x^Xu. 
where Xn C X, and /(x) = 0 elsewhere, the Hou^ 
transform of Xm* relative to a functional form 
f :^ )C Q [0. 36 ). hsa, the simple fprm dc6ncd by 

«(fl) « € Xil for some <7 e a. Hx, fl) - 0). 

The Hough transform/is u tittii!ironn which can aid 
in tlM detection of image arcs of a ^ivcn shape or 
form or 3D object sfapes- Each shape or form has 
some free parameters which when specthed precisely 
dc6ne the arc. shape or form. The shape having free 
parameter tf corresponds to the set {x € X\ F{x^ q) - 
0}» The free par^metcr^ consiitute the tr^nsfbrm 
domain or the parameter space of the Hou^ trans- 
form. Depending on the information available to the 
Hough transform* each neighborhood of the image 
or pbjca surface being transformed will map to a 
, point or a set of points in the Hough parameter 

s^ncc. The Hough tnin!^Onn diserctizcs the Hough 
parameter space into bins and counts for each bin 
how many neighborhoods on the hnage or object 
surface has one of its transformed points He in the 
volume assigned to the bin. 

102. The Gaussian sphere refers to a unit sphere 
and its associated spherical coordinate system. The 
quantities usually reprcscnied on the Gaussian 

' sphere are Orientation vectors. 

103. Gradient space is a two-dimensional spate 
whose axes represent the first order partial deriva- 
tives of a surface of the form z = /(x. v). Each point 
in gradient space corresponds to the orientation of a 
possible surface normal. 

104. The extended Gaussian image or orientation 
histogram of a 3D object ts 3 two^imensionol his- 
togram or Hough transform of the surface normal 
orientations ot the objca. It is computed by tear 
sellating the surface of a sphere into cells and 
assigning to each cell a value which estimates the 
total area of the object's surface having surfaice nor- 
mal orientation which falls within the cell. 



9. DICrTAL CfiOMETRY 

tOS, The EucUdean distance between two points 
p- Pi px) and q^iqi gs)h defined by 



dip,q) =1/2 ipu 

106. The block or eity distance between two points 
p B (pi ps) and q « iqi ^.v) is defined by 

1-1 ' 



107. The square or tnax distance between two 

points p (pi ps) and " (91 ^.v) is 

defined by 

dip^q)" max \p^-q^\. 
««i .V 

10$. The distance transform of a binary image is 
an image having in each pixel's position its dtstanoe 
from the nearest binary zero pixel of the input image. 
Distance can be dty block distance, Eudidcan dis> 
lanCe. ot M^uare distances. . 

109. A figure F or a subima$e F in a continuous or 
digital image / is any function F whose domain is 
some subset i4 of the set of spatial coordinates or 
n»lution cellji. whose range is the set of image 
intensities and which is defined by F{r,c) ^ /(r.c) 
for any (r.c) belonging to A, 

110. A region /I of an image is any subs^ of 
resolution cclU in the spatial domain of the image- 
Ill. A neight>oring pair of pixels are said to be 4- 

Qonnected if they share a common side, A neigh- 
boring pair of pixels are said to be Connected if 
they ^harc a common side or a common comer. 

112. A region R is connected if there is a path 
between any two resolution cells cantuncd in R. 
More precisely. R is4^onnected (8-conncctcd) if for 
each pair of resolution Ccib {r.c) and (u. u) belonging 
to R, there exists some sequence ((a\.b\), (a;.f>>). 

of resolution cells belonging to R such 

that (r.c) - ■ la^,b^). and (fli.Ai), 

is 4-ccnnected (8-conneeted) to f • 

1.2 m-l. 

113. A btob OT connected component Is a maximal 
siwd connected region. 

114. A digitai straight tine segment between reso- 
lution cclb (ri . f I ) and {r^ . c;) is that subset of ail 
pixels such that some part of the line segment joining 
(r,.c,) and {r2Xz) has a non-empty intersection 
with the pixcPs area, 

115. A region R is conc^ex if for every pair of 
resolution cells in /?. R contains the digital uraigbt 
line Segment Which joins the pair of resolution cells. 

lib. A pixel is an interior border pixel of a region 
A if the pixel belongs to R and neighbors a pixel 
outside of R- 

1 17. A pixel is an exterior border pixel of a region 
R if the pixel docs not belong to and neighbors a 
pixel belonging to R. 

lid. A pixel is un interior pixel of a region R if 
every pixel it ncightwrs belongs to R, 

1 19. A simple boundary is an oriented closed curve 
which does not touch or cross itself. Pixels which are 
on the inside of a simple boundary constitute 3 
connected region having no holes. 

120. The bounding coniour of a region R consists 
of the simple boundary which surrounds the pixels 
of R. 

121. A set of pixels H constitutes a hole of a region 
R itH\S9i maximal connected set of pixels which do 
not belong to R but which arc surrounded by R. 
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122 JhtbcrderorboundoryofAConntvtfjiif^VOTi 
R conklsts of its bounding coniour and the ( p«sibly 
empty) set of «n.plc bound^cs -^^J^f sur^ 
rt^unds the pixels belonging to some hok of K. 

1^ Bourtdarv following refci. to the sequential 
procedure by which the diain of the boundaiy pixds 
of a repqn can be deiennined, 

124. A confMfPif is a continuous curve, usually 
represcntina a blob boundi^O'. consisting of a con- 
nected chain of simply described arcs. 

125. The winimp/n ;>erifTtewrpo/y5o/t of a dipial 
curve C is the polygon of shortest length whose 
dlgiiization is C The shape of the nummum pcrv 
meter polygon is often similar lo the gcneml per- 
ceived shape of the digital curve- 

126. Contour tracing is a scarchirtg or iraversing 
process by which the bounding contour of a Wob can 
be Indentified. 

to. 30 $BAI*C DSSCUFTION 

127. The perimeirr of a connected region R is the 
length of the bounding contour of 

128. The area >\ of a rcpon R »s defined by 

where 5 is the scale factor which specifies the area off 

' V^$^'Thc ctntri^d {f.c) of a region H is the center 
of mass of the region. It is the mean (row. column) 
position for all pixels in the region and is given by 



130. The (/. * ^^^^ '^'^ ^ 

is given by 

The center of gjravity (r. O of -J can be expressed 
in terms of the momente of 5: 

131. The U'*=)*h ^^^^'^ momeni Mi* of a digital 
shape S is given by 

^^-2 (r-r-)'(c-cl*. 

lr.i-ie.l 

132. CA *)th ttormaliztd central moment of S Is 
given by 



. where r 



2 



133. Rofathn mpvttwiti momenta of 5 are given 

Pll)»'>2n'*'*Jl« 



- - 31112)2 + (3fl2, - 110)=* 

^(5) - Ci|jo - 3f)i2)(l3ii + liiXClJn + n\i)' 
-3(n;i +T)oj)'l 

+ (3r?:i - 1703) nci.0l3<n>i lis)' 

^(7) = (3iii, - i7«i)(r?jo + »?I3)ICD3I» + "Jii)' 

- 3<n=i *lio)-l 

- {jj^ - 3i;i:)('>:i + nnj)l3ll» + ni:)" 

134, The Sider number of a region is the number 
of its connacted components minus the number of 

its holes. ^ . 

135. The eompacmess of a blob can be measure* 
by the lengtfi of its perimeter squared divided by 
its area or alternatively measured by the standard 
deviation of the radii from the ccniioid to the bound- 
ary divided by the mean radius- The clasical measure 
of perimeter squared divided by area has the dis- 
advantage thai in the digital domain it takes its 
smallest value not for a digital drdc but for a digital 
octagon or diamond depending on whether B-con- 
nects^^ty or 4^nnBCtlvity is used in calculating the 
perimeter, 

136. The l»eifvidifi8 reaangU of a region K » a 
rectangle which circumscribes R. It has its sides 
aligned with the low and column directions, its left- 
most side aligning with the lowest numbeied column 
of R. its rightmost side aligning with the highest 
numbered column of «. its topmost side ahgmng 
with the lowest numbered row of R. and 
tommosi side aligning with the highest numbered 

TOW of R. ^ ft L ■ 

137. An txtrtnuxl pixel of K is a pixel of R having 
from among all praels in R either 
(«) an extremal row coordinate value r and an 
extremal column coordinate value taken from 
among all the column positions c such that 

(b) an extremal column coordinate value c and an 
extremal tow coordinate value taken from among 
all the row positions rsuch that tr.c) € R^ 
A region mav have as many as eight distinct 
eatiemal points.'each of which must be lying 00 the 
bounding rectangle of the region. Extremal pixels 
can be used to represent the areal extent of a region 
and to infer the dominant axis length and orienution 
of the region. 
138. The second moment matrix 
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of a region R a ddiitcd by 

where A h the area or the region, s, is [he row scale 
factor, and is the column waJc (actor, f is the row 
ccntroid. and c in ihe column ceniroid. 

139. The elonf^aiion or tiongatedness of » Wob or 
connected region can be measurecl in a variety of 
ways. One technique is to use the ratio of the length 
of the muimum Icn^h Chord in the blob to the 
length of its maximum length perpendicular chord. 
A second icchniqne is to use the iquare root of the 
ratio of the largest to smallest eigenvalue of the 
second centra! moment mairix Of th« blob. A third 
technique is to use the ratio of the Urgc5i distance 
between an opposing pair of extremal points to the 
distance between that, opposing pair of exiremaJ 
points having next to largest distance. 

140. The symmetric axis Of medial axis of a blob 
is a subset of blob pixels which are the centers of 
maximal lines, squares or disks which are contained 
in the blob. Associated with each pixel which is 
part of a symmetric axis may also be additional 
information such as the size of the maximal line or 
square or the radius of the maximal disk of which it 

the center. 

141. The connected component operator has as 
input a binary image and produces as output an 
image In which each binary one pixel is given a 
unique label of the maximally connected component 
of pixels having a binary one value to which it 
belongs. 

142. In connecjed component tmoiyzis or blob 
analysis, the position and shape properties of each 
connected component arc measured. Typical shape 
piopertics include arca« pcrimcier« number of holes, 
bounding rectangle, extremal points, ceniroid. 
second moments, and orientation derived from 
second moments or extremal points. The connected 
components are then identified or classifted by a 
ckdsion rule on the basis of its measured propcrtici. 

143. Signature analysis Of a binary image analyses 
the binary image in terms of its projections^ Pro- 
jections can be vertical, horizontal, diagonal, circu- 
lar, radial, spiral, or gcneinl projections. The 
analysts consists of computing tbt projections, seg- 
menting each projection, and taking property 
measurements of each projection segment. Signature 
analy&is m^iy also use the projection segmentation to 
induce a segmentation of the Itnage. 

144. A binary image projtchOH i% the histogram of 
the gray scale image prodiraed by masking n pro- 
jection index image with the given binary image. 



Each pixel of the projection index image contains a 
number which is the index of the projection bin to 
which the pixel belongs. A hbiogram of the masked 
projection index image then contains in projection 
bin i the number of pixels which on the binary image 
have binary valtie one and which on the projeaion 
index image have index vahse i. 

11. CVBVC AND IMaCC DATA CTUtJCTtmeS 

145. The Fourier descriptors of a closed planar 
curve are (he COeffiCienls of the ^ourict series of the 
spatial positions of the curve ds a function of arc 
length. Typically the low frequency coefficients arc 
the ones of greatest interest. 

146. fteraliue end point curve fitting refers to an 
iterative process of segmenting a curve into a set of 
pieccwisc linear segments which approximate, the 
curve. The process begins by' constructing a straight 
line between the end points^ of the curve. If the 
furthest distance between the curve and the straight 
line is less than a specified tolerance then the approxi- 
mation is considered to be suitable and the cqrve 
segment is divided no further. If the furthest distance 
between the curve and the straight line is greater 
than a specified tolerance, then the approximation 
is considered io be noi suitable. The curve is then 
divided Into two segments at this furthest distance 
point and the straight line fitting process Inde- 
pendently continues on each segment. 

147. The chain code representation of a digital arc 
or blob boundary is a sequence in which each element 
is a symbol representing the vector joining two neigh- 
boring pixels of the digital are Of blob boundary. The 
most common chain code uses the symbols 0 to 7 to 
represent the vectors (0, I), (-1. 1). (-1. 0)« (-1. 
-1). (0. -1), (K -1), (-1, -1}. and (-U 0) of row 
column coordinates, which can join two neighboring 
pixels. More complex choin codes have more symbols 
and can represent the Vector joining two more distant 
pixels which delme the beginning and ending of a 
digital straight line segment which is paa of a dlgftal 
arc or blob boundary. 

148. A quadtree A a ifee data structure which 
represents an image. £aeh node of the quadtree 
represents a squatE subset of the image's spatial 
domain. The root node of the quadtree represents 
the spatial domain of the entire image. If all the 
pixels of the spatial domain subset represented by a 
node have the same value, then the value of the node 
a. the value of the pixels In the subset. Such a node 

. is called a pure node. U the node is a mixed or impure 
node, then the square represented by the node is 
panitioned into four quadrants and the node Has four 
children nodes, one child node for each quadrant. If 
the nnage being represented is a binary image, then 
the corresponding quadtree is called a binary 
quadtree. If the image being repre^nied is a gray 
scale image, then the corresponding quadtree is 
called a grey scale quadtree. 
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149, A curve pyramid consht& of a jicqueiKC of 
symbolic images representing curves ai multiple reso- 
lutions. The main opcriuion in a botiom-up oon- 
fitiucTion consists of locally connecting the short 
segments of the curve into longer ones. Tf the seg- 
ments are described by binary "curve relations'" of 
the labeled sides of a square cell, the concatenation 
of the *hort segments can be achieved foTtnally by 
taking the irjnsitivc closure of the cutve relations. 
Overlapping p>Tamids arc necessary If the resulting 
pyniittid is to have the "length reduction property": 
long curves with many segmcpti survive to high 
levels, whereas short curves disappear after 9 few 
reduction steps. 

150. An octrte is a data in a tree data stniCiurc 
which represents a function defined as a ihree-dimcn- 
skmal space volume. Each node of tht octree rep- 
resents a cube subset of the volume. The root node 
of the quadtree represents the entire volume. If all 
the voxels represented by a node have the .-uime 
function values, then the value of the node is their 
function value. Such a node is called a pure node. If 
the node is a mixed or impure node, then the cube 
Teprcsenlcd by the node is partitioned into ei^t 
vohime octants and the node has eight children, one 
chnd for each octant. If the function is binary, then 
the corresponding ocuoc is caUcd a binary oarte. 
The binary octree Is useful for reprcscniing thre^ 
dimemional volumes. If the function being repre- 
sented is a non-binary, such « a real or integer 
valued funaion. then the eoncsponding ociree is 
called a grov ycale octrte, 

15L Run iength encoding is a way lo compactly 
represent binar>- images. There arc a variety of run 
length encoding formats. Each format has a way 
qf reptescntipg the starting column position of a 
maximal Iv long horizontal string of binary one valued 
pixels as irell as the number of pixcU in a run. Many 
vision systems which recognize objects from their 
binary images use run length encoding to reduce the 
voluiTic of data to be processed. 

152. A generalised cone or ftenfraliztd cylinder ts 
a data stmciurc for volumetric representation of a 
3D object. The volume is generated by sweeping an 
arbitrarily shaped cross section along a 3D curve 
called the generalized cone axis oi centralized cyl- 
inder spine. The axis passes through the ccmroids of 
the cross sections and is at a fixed angle lusually 
orthogonal) to them. The cross sectional shape is 
penniited to have some free parameters such as size 
or elongation. These values are specified for each 
aids pint by the cross seaion fimcrion or the sweeping 
rule, 

153. Constmaii^ solid geometry is a mechanism 
(or representing three-dimensional volumes by a con- 
structive process which begins with simple shaped 
Volumes and which are combined and subtracted 
from each other bj- the set of operaiions consisting 
of union, intersection and set difference. 

134. A boundary surface description or boundary 



representadon of a ihrec-dimensiona) object or vol- 
ume is a representation which contains each of the 
surface boundaries of the volume- Each surface 
boundary » represe nted in terms of ^mply described 
piece*, each of which has its own arc boundary. Each 
arc itself is represented in terms of simply described 
pieces which begin and terminate at end points or 
vertices. 

155. A superquadric is a closed surface spanned 
by a vector whose x. y. and t components arc speci- 
ned as functions of the an^tles and <ii via the sphcri-. 
cal product of two two^imensionat parametrized 
curves 



and 



Which come from one of three basic trigonometric 
forms. T^e spherical produd of h with m scaled by 

the vector (a^ is defined by 



156. A strip tree is a binary tree dau structure for 
hierarchically representing a planar arc segment. The 
root node of the tree represents the minimal siied 
rectangle which bounds the arc. Each non-terminal 
node of the tree splits the arc which its boundm^ 
rectangle approximates into two continuous pieces. 
Its two children nodes then each contain the minimal 
sized rectangle which bounds the arc segment piece 
belonging to it. Terminal nodes of the tree have 
bounding rectangles which are sufficiently close to 
the arc segment ihey conuin. 

157. The primal sketch is a data structure for rcp- 
rcscniiag gray level intensity changes, their geo- 
metrical distribution- andorgani^aUon in each image 
neighborhood. Primitive^ of the primal sketch 
include zertwrrossings. bi'obs. terminations and dis- 
continuities, edge segr^cnts, virtual lines, groups, 
curvilinear organizations, and boundaries. 

158. In facef model image processiing, the distal 
image's pixel values are regarded as noisy discrctized 
sampled observations of its underlying and unknown 
gray tone intensity >iurfacc. Any operation to be 
performed on the image is defined in terms of this 
underlying grav tone intensity surface. Thus, in order 
to do anv proc^ng. the underlying intensity surface 
must he estimated. This requires a model which 
describes what the general form ofihc surface would 
be in anv image neighborhood if there were no nose. 
To estimate the surfiice from the neighbortiood 



I 
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around a pixel then amounts to csiimaiing the free 
parameters of the gcwral form. Useful image pro- 
cessing Operations which then can be performed 
using the facet model processing approach indudc 
gradient edge detection, zrrcxrossing edge detec- 
tion, image scgmenution. line detection, comer 
detection. 3D ^pe estimation from shading. an4 
determination of optic flow. 

l2.TTXnJSE 

159. A discrete tonal ftoture on a dtglial image Is 
a connected set of resolution cells all of which have 
the same or almost the same image inteittiiy. 

160. Texture 15 ooncerned with the spatial dis- 
tribution of the image intensities and discrete tonal 
features. When a small area of the image has Uttlc 
variation of discrete tonal features, the dominant 
piopony of that 9rea is gray tone. When a small area 
has wide variation of disCTCte tonal features, the 
dominant property of that area is texture. There are 
three things crucial in this distinction: (1) the size of 
the small areas, (2) the reUtive sizes of the discrete 
tonal lcacures« and (3) the number of distinguishable 
discrete tonal fcHtnrcs. Texture ean be described 
along dimensions of uniformity, density, coarseness, 
toughness regularity, intensity and directionality. 

161. A f«rW, short for texture element, is a trlplcu 
whose fint component is the (row, column) location 
of a small neighborhood, whose second component 
is the size of the neighborhood, and whose third 
component is the vector of texture properties. 

1 62. The itftfy iet>el dependtnce matrix or ^my level 
concurrence matrix characterizes the micnHcxtvrc 
of an image region by mcusunng the dependence 
between paii^ of gray levels arising from pi wis in a 
specified spatial relation. For gray level pair (/, /) 
the gray level dependence matrix P for region R of 
image / has value /) where Pii, / ) is the number 
of paint of pixels in the region having the desired 
spatial relation where the first pixel has gray level / 
and the second pixel has gray level /. If S de^gnates 
the set of all pairs of pixels in the desired spatial 
relation, then S^R^ ft and 

ffi.i) - *W('i . I )- C*":- c *)) € , c») - I 
and 

The gray level dependence matrix P can be 
normalized. One normalized form which produces a 
joint probubiliiv is given bv 

A Second normalized foiin which produces u coo- 
ditioniil protiaWiiiy » given by 

o » ^C-/) 

I 

163. Sitttisticttt lexture mmun^ include the 



moments of the gray level* of the given region, 
typically the variance, the slcwncss and the knriosis. 

164. The gray ieuel difference histogram at a dis- 
tance d of an image / is the histogram of values 

<|/fr.c) - /(r'.c')|:(r- (c - f*>= - dH 

165. A struemral texture description is given by a 
set of primitives and placement rules which govern 
the stochastic spatial relation between them. 

166. Fourier reiated texture descriptions include 
the power spectrum and autocorrelation function. 

tX SEGMENTATION 

167. Image segmentation is a process which typi- 
cally partitions the spatial domain of an image into 
mutually exclusive subsets, called regions, each One 
of which is uniform and homogeneous with respect 
to some property such as tone or texture and whose 
property value diffcv^ in some significant way from 
the propeny value of each neighboring region. 
Regions produce4 by an image ssegmeniation process 
using image intensity as a propeny value produce 
regions which are called discrete tonal features* 

168> Region growing refers to a sequential image 
segmentation process in which pixels are successively 
added to incomplete regions or initiate new regions 
when it is not appropriate to make them part of any 
of the existing incomplete regions. There are three 
basic Wiitd» of region growing: region tracking, region 
aggregation, and region merging^ 

(a) 169. In region tracking, the image is scanned 
in raster scan onter. The similarity of each pixe) is 
compared with the regions to which the already 
processed 4- or 8<onnected neighboring pixcb 
belong. If one of these already processed neigh* 
boring pi^ls belongs to a region of sufflcient simi- 
larity to the current pixel, then the pixel is added 
to the region. If the regions to which all the already 
processed pixels belong are dissimilar from the 
current pixel, then the current pixel iqiriatesa new 
region. 

(b) 170. In rtgion aggregation, Kccd pixels are first 
found which serve as prototype pixels for the 
regions in the desired segmentation. Then in a 
sequential fashion, pixels having neighbors in any 
incomplete region join themselves into the region 
if they are similiir enough. The aggregation process 
continues until all pixels are part of some region. 

(c) 171 . In region merging^ ihc neighboring regions 
pf an initial segmentation are successively merged 
together if they have similar enough properties. 
After each mtrging itenuion, properties of the 
new re^ns ate recomputed. The mergirig iter- 
ations continue until the properties of each pair of 
neighboring regions is sufficiently different from 
each other. 

172. Contour filling is the process by which all 
pbtcls inside a blob defined by its bounding 
conU)ur(s) are marked with the same unique label. 
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173. Temphie matching is an opcr;itioa which can 
be used to find out how well s template subimagc 
matches a window of a given image. The <JcgreB 
of matdimg is often dctennlncd by translBUng the 
template subimage all over the given image and for 
each position evaluating the cross-correlation or the 
sum of the squared or absolute image intensity dif- 
for encds of corresponding pixels. Template maidiing 
pan also be used to best match an observed measure- 
ment paiiem with a prototype pattern. 

174. Matched filtering is a tempbic matching 
operation done by using the magniiudc of the cro»- 
coTTclaUon function lo measure the degree of nwlch- 
ing. 

175 . Imuge matching refers to the process of dcter- 
mining the pixel bv pixel, arc by arc. or re^oa by 
region correspondence between two imai?es taken of 
the same scene but with different sensors, differeirt 
lighting, or a different viewing angle. Image ntfttch- 
ing can be used in the speetnil/xcmpormi pattern 
classification of remote sensing, or in determining 
corresponding points for stereo, tracking, change 
annlysis* and motion analysis. In one group of 
approaches, subioiagcs of one image are. translated 
over a second image. For each translation, the dif- 
ferences between appropriately transfonned gray 
tone imcnsiiies and/or edges are meiisured. In ito 
signal level approach, the unit being operated with 
IS die pixel, since the measured difference is between 
values of pixels in two images, 

176. \i\^mboUcregistrati&nt>v symbolic matching^ 
higher level units arc worked with. For example the 
scene can be segmented and a region matching then 
performed using segment features such as area, posi- 
tion. pcrimclcrVa^a. orientation, length to width 
r^lio. area/area of minimum bounding fectanglc 
arca/area of bounding ellipse, gray tone mtcnsity 
or color of segment, and number of coirespondmg 
neighbors. Because this matching uses a higher level 
unit than the pixel, it is called symbolic matching or 
symbolic registration. . ^ . . 

* 177. In feature paint maicking, selected points Of 
each image arc^rst determined, on the basis of the 
distinctive image values in a neighborhood or on the 
basb of an inicriection between two feature ltne». 
The locatiotf of each point can be to subpixel 
precision. After the locations of dislineiive pomts 
are determined, a correspondence process associates 
. as many as possible selected points of one image with 
selected points on die second image. The cor- 
respondence is based an simiUiriiy of the feature 
characteristics of the points. 

178. A iiructurni dfscriprian is a rclatiaaal rep- 
resentation of a 2D or 3D emity. It consists of a 
of primitives each having its own atinbute 
description and a set of named relations which consist 
of tuples whose components arc primitives which 
stand in the relation specified by the relation name. 



A function AM — a is a niation homomorpMsm 
from N^vy relation R C A^' to /V-ary relation SQB 



where 'ROh^{{h, MS for some 

(a, as) eR,b^' « = 1- • • • ^ 

179. The relation R is said to maic^i relation S if 
there exists a reiatton homomorphism satisfying 

Roh^S and So/i"' ^ R 

ISO. Relational maiehing refers to the process by 
which h is determined whether two relations rnatch 
or do not match. Stmttural matching b a matchmg 
which csublishes a corrcspaodencc or bomam^r. 
phlsm from the primitives af one structural 
description to tiic primitives of a second structural 
description. In the ideal match a tuple of primitives 
which stand in a given retatian in the first description 
will have its corresponding tuple of primitives stand 
in the same given relation in the second structural 
description. , ^ . . , 

181. The loeai feamn focus method is a model 
based object recognition and location lechraquc in 
which one feature, referred to as the focus feature, 
on the image is found and is used alaog with the 
object model to predict what other nearby features 
Riidit be. After locating a set af features a relational 
matching b performed to infer a consistent cor- 
respondence between all the located image features 
and the object features. Once a consistent cor- 
Tcspondcnce has been found, the object position 
orientation can be hypothesized, Jh* hypothesized 
object position and oricmation is then vcnfied by 
template matching. 

182. Rdttxanon refers to any computational mech- 
anism which employs a set of locally interacting 
pftrallel processes, one associated with each image 
unit, which in an iierailvB fashion update each unit s 
cnrrent labeling in arder to achieve a globally con- 
sistent interpretation of the imagfi data- in di^crtic 
reUutatipn, the assessment of each unites cunent state 
consists of that subset of labels not yet ruled out. In 
probabHiuie rclaxaiion the assessment of each unit 
cuTTcntstaie is a probability fwncuon associating with 
each possible label a probability of its being the 
correct state. 



15. locauzation 

183. An inreresf optrawr is a neighborhood oper- 
ator which is designed to locale, with high spatial 
accuracy, pixel powiions. or subpixel positions, 
whose central neighborhoods have distinctive gray 
tone patterns. Such neighborhoods are typically 
those whose autocorrelation functions falls off 
rdpidlw. Interest opemtors are usually used to mark 
pixels'on a pair of images taken of the same scene 
but with some shift of cither camera position or 
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object from one image to another. The marked pUels 
iire then ihe candidate pixels which arc inpoi lo an 
algorithm whteh establishc» correspondences 
between the s«lectcd pixeb. 

184. An artQ pf interest oprntpr is an operator 
whidi dclincmes region* of an image which have 
potentially Inieresiing patterns. These delineated 
regions of interest the ones which must be further 
processed. 

185, Screening is an operation <>f selecting photO- 
gniphs or images conutining areas of potcntiAl inter- 
est from those in a set of photo jriiphs, some or most 
of which contain no interestinjg areas. 

]S6. In area analysis^ the ares of the image con- 
uining the objects or cnrides tcl' be processed is 
located by some &tmple algorithm and a more com- 
plex processing algorithm is only applied in ihc 
located area. This strategy of processing can often 
increase execution speed. The algorithm locating the 
area to be processed is called the focus ofanention 
meehattism. 

1ft. CCNCICAL IMAGE VROCESStSG 

187. Pteprocessin^ is an operation applied before 
panem identification is performed. Preprocessing 
produces, for the categories of interest, pattern fea- 
tures which tend to be invariant under changes 5\ich 
as translation, rotation, scale, illumination level, and 
noise. In essence, preprocessing converts the 
measuremeni patterns to a form which allows a sim- 
plification in the decision nile. Preprocessmg can 
bring into re^tnition. bring Into congruence, 
remove noise, enhance images, segment target pat- 
terns, delect, center, and normalize objects of loter- 

est. 

Id8. Re^isitrit\g or registration is the translation or 
translation and rotation aiigntneni process by which 
two images of like geometries and of the same set of 
objects are positioned coincident wiih one another 
so that corresponding points of the imaged scene 
appear in the same position on the registered images. 
Kn this manner* corresponding image values can be 
made to represent (he sensor output for the same • 
object point over the full image frame. 

189. Congniencins is the geomeiftc warping pro- 
cess by which two images of different geometries, 
but of the same sci of objects, are spatially trans- 
formed so that the size, shape, position, and orien- 
tation of any object on one image is made to be the 
same as the size, shape, position, and orientation of 
that object on the other image. 

190. Jmafie compression is an operation which pre- 
serves all or most of the information in the image 
and which reduces the amount of memory needed to 
store an image or the time needed to trtinsmit an 
image. 

191. image restoration h a process by which a 
degraded image is restored, as clearly or as best 
as possible, to its ideid condition. Perfect image 



restoration is possible only to the extent that the 
degradation transform is mathematically invenible. 
Common forms of restoration include inoerse 
filtering, Wiener filtering, and constrained least i^ud- 
res filiering. 

192. Image reconstruction refers to the process of 
reconstructing an image from a set of its profections. 
The projections may be taken along a set of parallel 
rays, in which case they are called parallel pro/er- 
fio/u, or they may be taken along a set of rays 
emanating from a point, in which case they are called 
fan beam projections. The most commonly employed 
reconstruction techniques arc the JiUered back prO'^ 
jeaion and the algebraic reconstruction techniques. 
Image reconstruction techniques arc important in 
computerized tomography, nuclear medicine, and 
ultrasonic imaging. 

\9^, Image enhancement is any one of a group of 
operations which improve the detectability of 
objects. These operations include, but are not limited 
to, contrast stretching* edge cnhanccmcni. spatial 
filtering, noise suppression, image smoothing, and 
image sharpening. 

194. image processing of picture processing 
encompasses all the various operations wtiicb can be 
applied to image data. These Include, but ate not 
limited io« image compression, image rcstoratioo. 
image cnhdnccment, preprocessing, quantization, 
spatial filtering, matching, and recognition tech- 
niques. 

t9S. Interaction image processing is carried out by 
an operator or analyst at a console with a means of 
accessing, preprocessing, feature extTactingt dassl* 
^ing. identifying and dispUying the original imagery 
or the processed imagery for subjective evaluation 
and further interactions. 

17. VISION 

196. Structured light nfcn to a technique of prt>- 
jccting a carefully designed light panem on a scene 
and viewing the scene from a different direction. 
Usually the' pattern consists of successive pbnes of 
light at different positions and orientations. Those 
pixels which image a surface patch which is tit by a 
known tight pattern have suMdeni information to 
determine the 3D coordinates of the surface patch 
since the light pattern is designed so that the line of 
sight paming through the pixel and the lens will 
intersect the known light pattern in a unique pomt. 
For stereo matching purposes, the structured light 
pattern may be *ninstnicture<r in the sense of being 
a texture pattern or consisting of random stipples. 

197. LfgfcrjiWpiVigreferttoaslmplefor^ofsiroc- 
tured lighting in which the light pattern consists of 
successive planes of light which are all parallel. 

198. Stercopsis refers to the capability of deter- 
minmg the depth of a 3D point by observing the 
point on two perspective projection images taken 
from different positions. 
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199. A stereo imo$e pair refer* to two pewpccOvc 
projection images taken of the same scene from 
slightly different positions. The common area 
appearing in both images of the stereo pair is usually 
4U% to 80% of the total image area. 

200. A point p on one image and a point q on a 
second Image arc said to form si corresponding point 
pair {p. q) if p and q are each a different sensor 
proieaion of the same 3D point- TlK vimal for- 
rtspondence problem consists of matching all pa»T» 
of eorresponding points from two images of the same 
scenc^ 

201. Disparity or stereo dispanty refers to the dif- 
ference in positions of the images of the same 3D 
point in two perspective projection images taken 
from different positions. 

202. Sieno maiching refers lo the matching pro- 
cess by which corxesponi^ng points on a stereo image 
pair or identified. 

203. Trianguhtiort refers to the process of deter^ 
fflinins liie C;t, y. z) coordinates of a 3D pomt f rcmi 
the observed position of two perspective projec- 
tions of the point. The centers of pefspcctivny 
and the pcf3pective projection planes arc assumed 

known. . . u 

204. The epipotaraxis of a stereo image pair »s the 
line passing through the center of pcrrspccttvittes of 
the image. 

205. The two epipola of a stereo image pair consist 
of one point on each of the perspective projection 
planes dctennincd as the intersection of the image 
plane with the epipolar axis. Foi* stereo ira»gc pairs 
having parallel perspective projccrion image pJancji, 
theepipolcs are infiniicly far to the left and nght. 

206. An epipolar my is the line segment between 
an Bpipole and a point on the perspective projection 
image plane. 

2D7. An epipoiar tine on one stereo image cor- 
responding to a given point in another stereo image 
b the pefspecrive projection on the first stereo image 
of the 3D ray which is the inverse perspective pro- 
jection of the given point from the other stereo 



20$. An epipolar plane relative ro a pair of stereo 
images is any plane determined by an observed 3D 
point, ihe position in 3D space of its perspective 
projection on the left stereo image and the position 
in 3D space of its perspective projection on the 
right stereo image. Every epipolar plane contains the 
epipolar axis and every plane which contains the 
epipolar aais is an epipolar plane. 

209. An occMtng boundary is a boundary appear- 
ing on an image due to a discontinuity in range or 
depth of an object in the observed scene. 

210. For each fixed viewing position and point 
source of illumination, the reflectance map is a fiinc 
don defined on gradient space which specifies a 
surface's reflectivity. Thus, at each possible oricn- 
Udoo of the surface normal [as encoded by the 
surfacc'i first order partial derivatives) the surface's 



reflectance map specifics the reflection coeflkicnt of 
the surface. 

Ill, Shape from shadins refers to the capabihty 
of determining the 3D shape characteristics of an 
object from the gray tone shading miinifestcd by 
the object's surface on a perspective projection or 
onhographic projection image, that is. from its 
reflective map. 

212. Local shading analysis refers tq the capability 
of inferring the shape and prcdominam tilt of a 
section of an object's surface by the image intensities 
in a local neighborhood of a pcrapeaive or parallel 
projection view, 

213. Photometne sterto refers to the capability of 
determining surface orientation by means of the 
shading variations present on two or more images 
taken of the same scene from the same position and 
qricmation but with the Kght sonrce in different 
positions- 

214. The motion field or image flow is an image 
in which the value of each pixel is the projected^ 
transUtional velocity arising from a surface point of 
an object in motion relative to the camera. Each 
projected translational velocity vector is caUcd an 
optic flow t>eaor, 

215. An optic flow or optical flow image is an 
image in which the value of each pixel is the estimated 
projected translational velocity arising from a surface 
point of an objea in motion relative to the camera. 
Because the projected velocity may not be estimable 
at each pixel, there may be some pixels In an optic 
flow image having no optic flow informatioft. 

216. The focus of expansion of a motion field 
image arising from a moving camera and stationary 
scene Is that point on the image at which the optic 
flow is zero and such that the optic flows of the 
neighboring points are directed away from it. In 
cases of relative motion toward the camera, there 
will be exactly one focus of expansion point in such 
a motion field image. In a motion field Image arising 
from an object in relative motion to the camera, the 
focus of expansion is that point on the image having 
all the optic flow vectors arising from the moving 
object directed away from it. 

217. The focus of cpntraaion of a motioti field 
image arising from a moving camera and stationary 
scene is that point on the image at which the optic 
flow is zero and siteh thai the optic flows of the 
neighboring points arc directed toward tt. In cases 
of relative motion away from the camera, there will 
be exactly one focus of contraction point in such a 
motion field image lo ■ moiioo tiM image arising 
from an object in relative motion 10 the camera, the 
focus of contraction is that point on the nnagc having 
all the optic flow vectors arising from the moving 
object directed toward ii. 

218. Structure from motion refers to the capability 
of determining a moving object's shape charac- 
(eristics, and its position and velocity as well, from 
a sequence of two or more images taken of the 
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moving object. Equivalently. if the camera is in 
motidn. !itruciure from mou'od refers lo the capa- 
bility of determiiung an object's shape 
charocicriKtics, and it^ poiation and the camem'y 
velocity, from a nequence of two or more images 
taken of the objeet by the moving camera* One 
fundamental kind of structure from motion problem 
is to determine the fixed position of M 3D points 
from a time sequence of N views and coniaining the 
Zti perspective projection of the M 3D points. 

2L9. Passiue nauisafion refers to the determi- 
nation of the motion of a camera from a time varyinui 
imn^ sequence. 

22a Dynamic scene anniysis refers to the analysis 
of time varying imagery. The purpose of the analysis 
may be to irack moving obieets. determine the 
motions of The objecu. recognize the objects, deter* 
mine the spatial positions of the objects at the time 
each image was obtained* or determine a shape 
description or charactcrizBiion of one or more 
objects. 

221. Shape from te^tun refers to the capability 
of determining the 3D shape characteristics of a 
homogeneously textured surface from the tc^tute 
density variations manifested by the surface on a 
perspective projecdon or orthographic projcciion 
image. 

222. Surface reeonstruaion refers to the process 
by which a 3D surface is analytically described by its 
boundary represents rion on the basis of processing 
a stereo Image pair, a range map. or a ume varying 
image sequence of the objicrved surface. 

223. Shape from contour or shape from shape 
refers to the capability of inferring the 3D shape of 
an object from a 2D perspective projection view of 
a set of regularly marked contotu^ on the object^s 
surface. 

224. The 21D sketch is a multiband Image, cadi 
pixel providing information about the depth and 
surfoce oricrtiation of the surface projected on it as 
well as providing an indication of the existence of a 
nearby depth discontinuity and an indication of the 
existence of a nearby surface discontinuity. 

225. The imrinsk scene eharacteristics for each 
object surface point arc: its depth from the iimigc 
focal plane, its surface orientation, its reflectance, 
and its incident illumination. 

226. An inxrinsk image is a multiband image in 
which each pixel contains the predominant intriiisic 
scene characteristics of the surface patch projecting 
to its position. Hence each pixel of the intrinsic image 
specifies depth, surface orientation, reflectance, and 
incident illumination for the surfaco patch projecting 
to its position. 

227. Inverse optics refers to the capability of infer- 
ring the 3D position and/or the surface normal of 
each point on an object*s surface and/or the surface 
shape from one or more perspective projection 
Images of the object. Included in the tcdiniqucs of 
inverse opitcs arc stereo, photometric stereo, shape 



from tfchading* shape from texture, and structure from 
motion. Inverse optics techniques can be thangbt of 
as techniques which invert the perspective projection 
process and which, therefore, belong to the recon- 
structi€inisi school of applied fAysics computer 
vision. 

228. The blocks world refers to a world in which 
all objects have simple surfaces. The most common 
kind of objects in 'the blocks world are polyhedral 
objects. 

229. A uiew aspect is a maximal connected region 
Of viewpoint space having the property thai when * 
looking at a given objeci*s center from any point of 
a view aspect, the resulting views ar^' topalogicaJly 
identical. 

230. An aspect graph A iLtr^\>f\ in wNch the nodes 
are the view aspects and the utc% connect adjacent 
view aspects. The views represented by the nodes in 
the graph are all the stable views, characteristic views 
and principal views. 

231. 30 vuion refers to the capability of a machine 
vision system to be able to infer some 3D charac- 
tehstic of an object or object feature such as its 
position » dimensions, orientation or motion or some 
3D characteristic of a point Of an object surface sudi 
as its 3D position or surface normal orientation. 

232- Automatic otsuai inspeaion or amomatic 
vision inspeaion refers to an inspection process 
which uiics a sensor producing image data and which 
uses techniques from image processing, pattern rec- 
ognition, or computer vision to measure and/or 
interpret the imaged objects in order to determine 
whether they have been manufactured within per- 
mitted tolerances. Automatic visual inspection sys- 
tems usually integrate the technologies of material 
handling, illumination, image acquisition and special 
purpose computer hardware along with ihe appro- 
piiatc image analysis algorithms into a system 
intended to be of practical use in the factory. BetKfits 
from using automated visual inspection can include 
more accurate, reliable* repeaiable, and complete 
quality assurance at a lower price and a higher speed 
of inspection than possible by mantial latwr. 

233- A machine vision system is a system capable 
of acquiring one or more images ofan object, capable 
of processing, analysing and measuring various 
characteristics of the acquired images, and inter- 
preting the results of the measurements in such a 
way that some useful dedsion con be made about the 
object. Functions of machine vision systems include 
locating, inspecting, gauging, identifying* recog* 
nizing« counting, and motion estimating. 

234. Visual fixturing or t>isual pose determination 
refers to the capability of inferring the position and 
orientation of a known object using a suitable object 
model and one or more cameras, range sensors, or 
triangulation based vision sensors. 

235. Opticaigaugins or uisual gauging refers to the 
ability to measure specific positions or dimensions of 
B manufactured object by using non-contact light 
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senativt sensors to compare these mcasurcmentt W 
prr«ilcctcd tolCTOCC limits tor quality inspcctwn 
and soning decision*. Gauging has wide applici.i.on 
in manufaciuring since it can deiermwe the d;a. 
metcri of hoki. opcninps. or cutontn. the wjdihs of 
shafB, components, gap*- ""^ 
relative locations of holcj, folds, feanirc^, coiii- 
* pooents. openings, or breaks. 

236. A gauging system can be either a/ufffi«p«- 
tian oxfiexibit inxptciion system. The fixed inspec- 
tion svsiem holds the part in a precision test fixture 
and )uis one or more sensors to take the required 
fneasuremcntB. Rcxible inspection utilizes seniofs 
that arc moved about the part being inspected, the 
motion being done alone » programmed path iro- 
jeciory. Flexible inspection gaugiftg is lomctimes 
called n>e»<wicifffiifii«g. 

237. A vision procedure is said to be robuss if 
small change* in the assumed model on which the 
procedure or technique was developed produce only 
small changes in the result. Small fraction* of the 
data wluch do not fit the assumed model and whidi 
in fact arc very far from fitting the assumed model, 
constitute a smaU change in the assumed modcL 
Data not fiiUng an assumed model may be due to 
rounding or quantising errors, gross errors, or 
because the model itself is only an idealized approxi- 
mation to- reality. 

23B. Contpmwr vision, image, uriaentandmg, or 
scenf tuwlyfis is that combination of image 
processing* pattern recognition/and artificial intcl^ 
Ugcnce technologies which focuses on the computer 
analysis of one or more images, taken wiih a single/ 
multiband sensor or taken in time sequence. The 
tmalysis recogniics. locates the position and oneo- 
uiion. and provides a sufftdemly detailed symbohe 
description or recognition of those imaged objects 
deemed to be of interest in the ihrcc-dimensional 
environment. The computer vision process often uses 
geometric modeling and complex knowledge rcp^ 
rcscntations in an expectation or model based match- 
ing or searching methodology- The searching can 
include bottom up. top down, blackboard, hicr- 
oithicat. and hcterarchical control strategics. 

239. The bottom up control strategy is an approach 
to problem solvini? that is data driuen, U employs no 
6bjcci models in its early stages and only uses general 
knowledge about the world being sensed. In a com- 
puter vision avstem using a bottom up control strat- 
egy, the observed image data is imerpreted and 
ugCTepaicd. Theinicrpretarionsand iiggrcgatiomarc 
then successively manipulated and aggregated until 
a sufficiently high level description of the scene has 
been generated. 

240. The top down control strategy is an approach 
to problem solving that is goaUdireatd or ezpeaation 
dimued- A form of solution is generated or hypo- 
thesized. Assuming the hypothesis is true and usmg 
the information in the knowledge data base, the 
inference mechanism then infers, if possible, some 



consbtent set of values for the unknown variables or 
paiamctcts. If a consistent set can be interred, then 
ihc problem has been solved. If a consisteiji set 
cannot be inferred, then a new form of soluuon is 
generated or hypothesized. In a computer vision 
svstem using a top down control structure, the num- 
ber or types of objects being sensed in the image is 
usually highly constrained and knowledge about the 
objects, relationships between objects, and object 
pans are all known. The system hypothesizes that 
the im«e shows a particular set of objects, infers 
values for paTamciers, and then tests to verify that 
the bypoiheas is consistent with the observed data. 

241. A hierarchical control strategy is an approach 
to problem solving in which the given problem is 
solved bv dividing It up into a set of subproblernS. 
each of which encapsulates an Important or major 
aspect of the ori^nal problem- Then each sub- 
problem is successively divided into more detailed 
snbproblcms. The refinement continues until the 
most refined subproblems can be solved dircdly, 

242. A blackboard conirol strategy is an approach 
to problem solving in which the various componcnu 
of the inference mechanism communicate with one 
another through a common working data storage 
area called the blackboard. When the blackboard 
has sufficient data to permit one component of the 
inference mechanism to make a deduction, the infer- 
ence mechanism goes to work and writes rcstriis 
on the blackboard where it becomes available for 
the oiher components of the inference mechanism, 
la this manner the inferred constraints are suc- 
cessively propagated and the required search is made 
more Hmiied. 

243. Model based computer vbion « a computer 
vision process which employs an explicit model of 
the object to be recognized. Recognition proceeds 
in a top down manner by matching the object data 
structure inferred from the observed image to the 
model data structure, 

244. Knowledge based vision refer* to a computer 
vision process which has an image processing eom- 
poncm. a reasoning or inference componem, and a 
knowledge daia base componem. The knowledge 
data base stores infotmation about the enviromncni 
being imaged. Thc^ image processing component 
extracts primitive piini. line, curve, and rcgion infor* 
mation from an cfcscrved image. Tlie reasoning or 
inference component is typically rule based and mte* 
grates the information produced by the image pro- 
cessing component with the information m the 
knowledge data base and reasons about what hypoth- 
esis should be ncatt generated, what hypothesis 
should be next validated, what new Information can 
be inferred from what has already been csublished. 
and what new primitives the image processing com- 
ponent should extract next. 



IS. PAHmS RECOCNmoN 

245. Panertt recognition techniques can be used to 
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construct decision rules which enable units to be 
ideniiried on the basis of their meaMircmcm patterns. 
Pattern recognition techniques can also be employed 
Id cltMicr lociether units having simiUr enough 
measurement Vauenis. In siatisrical pmem recos- 
nition^ the measurement patterns huve the form of 
n-tuples or vectors. In synmcric pattern recoftnitfon^ 
the mcD&uremrnt patterns have the form of sentences 
from the lan^agc of a phroM? struaure grammar. In 
structurul pautm ftcof^nMon. the measurements do 
not have the fbnn of un /i-tuple or vector. Rather, 
the unit being measured is encoded in tcrm» of its 
parts and the relationships as well as properties of 
the parts, 

246. Piaonal pattern recosm/iow refers to tech- 
niques which treat the image as a pattern and either 
categorize the image or produce a description of the 
image* 

247. The uniif is the entity which is observed and 
nvhose measured propeitio constitute the measure- 
ment pattern. The simplest and most practical unit 
to observe and measure in the patiem recognition of 
image data is often the pixel (the gray tone intensity 
or the gray tone intensity n-tupic in a particular 
resolution cell). This is what makes pictorial pattern 
recognition SO difficult, because the objects requiring 
analysis or identification are not single pixels but are 
often complex spatial formations of pixels. 

248. A mrosurrfnen/ poiient or paaem is the data 
siruciure of the measurements resulting from observ- 
ing a unit, 

249. A measurement n-tupic or measuretnetu uec- 
' tor vs the ordered /i-^tuple of measurements obtained 

from a unit under observuiion. Each component of 
the n-iuple is a measurement qf a particular quality, 
property, feature, or characteristic of the unit. In 
image pattern recognition, the units are usually pic- 
ture elements or simple formations of piaure 
elements and the mcasuremeni ^-tuples arc the cor- 
respgnding gtav tone intensities, gray tone intensity 
/t-tuplc5. or properties of formations of gray tone 

intend lidi. 

250. The Cartesian produa of two sct5 A and fl. 
denoted by i4 x is the wt of all ordered pairs 
where the first component of the pair is some element 
from the. first set and the second component of the 
pair is some element from the second set. The Car- 
tesian produa of S sets can be defined inductively, 

251- Measurement space Is a set large enough to 
include in it the set of alt possible measurement 
patterrts whidi could be obtained by observing some 
set of onits. 

252- The ran$e set /?, for the ftb sensor, which 
produces the /th Image in the multi-image set. is the 
set of all meusurcrtients which can be produced by 
the iih sensor. Simply, it is the set of all gray tone 
intensities which could possibly exist In the ith image. 
When the units are the pxcls, measurement space 
M is the Cartesian product of the range sets of the 
semors; Af * Ri x x . . . x 



253. Each unit is assumed to be of one and only 
one giveii type. The set of types is called the set of 
pmiem eiassa or cateftories C. each type being a 
particular category. 

254. A feature, or feature pattern, or feature'* n- 
tuple. QT feature pector or pattern feature is a #t-tuptc 
or vector whose components are functions af the 
initial measurement pattern variables or some subset 
of the initial measurement pattern variables. Feature 
n-tuples or vectors are designed to contain a high 
amount of information relative to the discriminaiion 
between units of the ty7>es of categories in the given ' 

-category set. Sometimes the features are pre- 
determined and other times they are determined at 
the time the panern discrimination problem is being 
solved. In image pattern recognition, features often 
contain itiformation relative to gray tone intensity, 
texture, or region shape. 

255. Frariire space is the set of all possible feature 
n-tuples. 

256. Feature selection is the process by which the 
features to be used in the pattern rccogntiion prob- 
lem are determined. Sometimes feature selection is 
called property seleaiott, 

257. Feature extraction is the process by which 
an imiial measurement pattern or some subset of 
measurement patterns is transformed to a new pat- 
tern feature. Sometimes feature extraction is called 
property extraction. 

The word pattern can be used in three distinct 
senses; 

1. as measurement pattern: 

2. as feature pattern; and 

3. as the dependency pattern or patterns of 
relationships among the components of any 
meastirement n-tuple or feature /i-tuple derived 
from units of a particular category and which are 
unique to those n-tuplcs, that is, they are dcpcn* 
dencics which do not occur in any other caiejory. 

258. A cUvsifier is a device or process tKat sorts 
patterns into categories or classes. 

259. The compactness hypothesis states that the 
pattern measurements of a given dass are nearer to 
cither pattern measurements in the class than ihey 
are to pattern measurements from other classes- 

260. The region of space occupied by pattern 
measurements earning from the same class or cat- 
egory is called a ciass region, 

261. TwQ classes or categories are said to be sep- 
arable if their dass regions do not overlap. If for 
every class region there exists a hypcrplanc which 
separates the class region from all other class regions, 
the classes are said to be linearly separable. 

262. A prototype pattern or reference pattern is the 
observable or characteristic measurement or feature 
pattern derived from units of a particular category. 
A category is said to have a prototype pattern only 
if the characteristic paitera is hijjily representative 
of the n-tuples obtained from units of that category. 

263. A data sequence S^^id^^d^ is a 
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sequence of patterns derived from the measurement 
paltcms or features of some sequence of observed 
units, d, is the pattern associated with first unit; 
is the pattern associated with the second unit: and d, 
is the pattern associated with the )th unit- 

264. A decision rule ( usually assigns one and only 
one category to each observed unit on the basis of 
the sequence of mosurcment patterns In the data 
sequence S4 or on the basis of the corresponding 
sequence of feature patterns. 

J65. A simpie decision rutr i% u decision rule which 
assigns a category to a unit solely on the basis of the 
measurements or features associated with the unit. 
Hence, the units arc treated Indcpendenily and the 
decision rule f may be thought of as a function which 
assigns one and only one category to each pattern in 
measurement space or to each feature in feature 
space. 

266- A kierarchica! decision rule is a decision rule 
in a tree fonn. In binary trees, each non-ierminal 
node of the tree contains a simple decision rule which 
classifies patterns as belonging to Us left child or to 
its Tight child. Each terminal node of the tree contains 
the assigned dass or category of the observed unit. 

267. A compound decision rule is a decision rule 
which assigns a unit to a category on the basis of soine 
non-trivial subscqucncc off measurrment panems in 
the data sequence or in the corresponding sequence 
of feature patterns- 

268. Provision can be made for a decision rule to 
rf^erve judgment or to defer assisnmem If the pattern 
is too close to the category boundary in measurement 
or feature space. With this provision, a deferred 
assignment is an assignment to the category of 
•*rcserved judgment". 

269. A category identification sequence or ground 
truth iV =" (C), c.. .... c/) is a sequence of category 

tdentifkaUons obtained from some sequcnec of 
observed units, c, is the category Ideniification of 
the first unit: is the category identification of the 
second unit; and is the category identification of 
the /th unit. 

270. A training sequence Is a set of two sequences; 
(1) the data sequence and (2) a corresponding cat- 
cgory idcrtiification sequence. A training datum it 
the pair consisting of a pattern in the daU scqiicnec 
and thc/torresponding category identification 111 the 
cpicgoty identification sequence. The trBining 
sequence is used to estimate the category CDnditlonal 
probability distributions from which the dceision rule 
is constructed or it may be used 10 esiin»atc the 
decision rule ilselL 

271. A training procedure is a procedure which 
uses the training sequence to construct a dcdsion 
rule. It may operate by pas^ng through the entire 
training sequence one time and construct the decision 
rvle in a manner which is independent of the order 
in which the training data occurs in the training 
sequence. It may operate itcrarively in which case it 
passes through the training sequence many dmes and 

|lt4ll<C 



after handling each training datum, it modifies or 
updates the decision rule. Such iterative trsining 
procedures may be affected by the order in which 
the training data occurs in the training seqtience- 

272. A window training procedure is an iterative 
training procedure in which each adjustment of the 
decision rule is made only when the training datum 
falls within a spedfied window, a subset of the pattern 
measurement space. UsuaHy this subset or window 
contains the decision boundary, 

273. An error correcting training procedure i& an 
iterative sequential training procedure In which at 
each iteration the decision rule Is adjuaied in 
response to a misclassification of a training datum. 

21 A. A classifier is said to learn if its iterative 
training procedure increases the daisification pcf 
formancc accuracy of the classifier after each few 
iterations- 

275. The conditional probability of a mcasuremcm 
or feature n-tuple d given category e is usually 
denoted by P^d). or by P{d\c), and is defined as the 
relative frequency or proportion of times the n'tupte 
d is derived from a unit whose true category identic 
fication is c. 

276 . A distribution-free OT non-parametric decisioa 
rule is one which makes 00 assumptions about the 
funaional form of the conditiomil probability dis- 
tribution of the patterns given the categories. 

277. A simple rrmximum likelihood decision rule 
. is one which treats the units independently and 

assigns a unit u having pattern measurements or 
features d to that category e whose units arc most" 
probable to have given rise to fKkttcm or feature 
vecu>r d. that Is. such that the conditional probability 
of d given c is highest. 

278. A simple Bayes decision rule is one whieh 
treats the units Independentiy and assigns a unit u 
having partem measurtmenis or features d to the 
category c whose conditional probability, given 
measurements d, is highest. 

279. Let <M,, Ml «,) be a secfitence of units 

with corresponding data sequence {dx. d-* d^ 

and known category identification sequence 

(c„ cj c,)- A simple nearest neighbor decision 

rule is one which treats the units independently and 
assigns a unit v of unknown identiftcation and with 
pattern measurements or features d to eaiegory e^ 
where di is that pattern closest 10 d by some given 
metric or distance function. 

2B0. A discriminanrfunefhnfM is a scalar func- 
tion, whose domain is usually measurement space 
and whose range is usually the real numbers. When 
/(d) a /4(d), for * - I. 2 ... IC, then the decision 
rule assigns the rth category to the unit giving rise to 
pattern d. 

281. A linear discriminant function / is a dis- 
criminant function of the form fid) ^ 2 + ffn 
where d • (d,, d} represents the measure- 
ment pattern. 
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382. A quadratic discriminant function / is a dis- 
criminant function c^f the form f\4\ ■ 

I 2 2 + 2 afii + an. 

283. A decision i>oundary between the /th ami icth 
categories is a subset H of pattern in mci&urement 
space M defined by 

H»{d€M\f,(d)MfUd)l 

where /, and /fc are the discriminant functioTu for ih« 
ith and Jcth categories* / 

284. A Hyperplanc decision boundary is the special 
name given to decision boundaries arising from the 
ttse of linear discrriminant functions. 

285. A lintar dtdsion rule is a simple statistical 
pattern recos'^'^^'^ decision rate which visuidly treats 
the units independently and makes the category 
assignments u^ing linear discriminant functions. The 
decision boundaries obtained from linear decision 
rutes are hyperplanes. 

286. The pattern discrimination problem is con- 
cerned with how to construct the decision rule which 
assigns a unit to a panicuUur category on the basts of 
the measurement pattcm(s) in the data sequence or 
un the basis of the feature pattcm(s) in the data 
scqucnce- 

287. Ponern idtntificaiion is the process in which 

a decision rule is applied. If 5, «■ (ui. u> u,) is 

the sequence of units lo be observed and identified. 

and if S4 ^idi^d^ dy) is the corresponding data 

sequence of patterns, then the pattern identification 
process produces a category identiftcaiioo sequence 

5, - <C|* c: C/) where c, is the category in C to 

whidi the decision rule aligns unit Ui on the basis of 
the y patterns in 5^. In general, each category in 5<. 
can be assigned by the decision rule as a function of 
ail the patterns in S4, Sometimes pattern . identi- 
fication is called pamm ciassijication or dassification. 

288. A ptrctprron or neural network is an tirtcr- 
connected network of nonlinear units or processing 
elements capable of leaming and self organizing. 
The response of a unit or a processing element is a 
non-linear monotonic function of a weighted som of 
the inputs to the processing elements. The weights* 
called ivn£ipf/c weights are modifiec^by a leaming or 
reinforcement algorithm. Typical nonlinear pro- 
cessing functions are sgn(jr)« ^ ^ >andtanh(x)> 

When each procesiung element contributes one com- 
ponent to the output response vector and its inputs 
ore selected from the comfwnents of the input pat- 
tern vector, the pcrceptron is called a simple 
perceptron. Processing units whose output only 
indirectly influences the components of the output 
response vector are called hidden miss, 

289. An error corrective reinforcement for a per- 
ecptron is a learning or training algorithm in which 
the change in a synaptic weighu is a function of the 
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degree to which the output of the processing unit 
IS not what it is desired to be. Error corrective 
reinforcement algorithms arc also called ^rror back 
propagation alicorithms. 

290. A forward coupled perceptron is a pcrceptron 
in which the processing units are layered. The inputs 
to the processing units in layer n come from the 
outputs of processing units in layers prior to layer n, 
Singk layered pcrceptrons can create linear decision 
surfaces. Two layered pcrceptrons can create con- 
vex decision regions. Three layered percept rons 
can create almost arbitrarily shapcti decision 
regions. 

291. A series coupied perceptron is a forward 
coupled perceptron in which the inputs to the pjo- 
cessing center In layer n come from the outputs of 
processing units in layer n - I. 

292. A back coupled perceptron is a perceptron 
which b not forward qpupled. That is. there is some 
processor in layer n where output feeds back, and is. 
the input to a processor in some layer prior to layer 
n, 

293. A duster is a homogeneous group of units 
which arc very "like" one another- '•Likeness" 
between units i.*; usually determined by the associ- 
ation, similarity* or distance between the measure- 
ment patterns a.<isociaicd with the units. 

294. A cluster assignment function is a function 
which assigns each observed unit to a duster on 
the basis of the measurement putiem(s) in the data 
sequence or on the basis of their corresponding fea- 
tuiBS. Sometimes the nnhs are treated indepen- 
dently. In this case the duster assignment function 
can be considered as a transformation from measure- 
ment space to the set of clusters. 

295. The pattern daisification problem is con- 
cerned with constructing the duster assignment func* 
tioo which groups similar units. Pattern classification 
is synonymous with numerical taxonomy or cfur- 
tering. 

296. The duster identification process is the pro- 
cess in which the cluster assign meni funaion is 
applied to the sequence of observed units thereby 
yielding a duster identification sequence. 

297. A misidentificatiart^ or misdetection. or type I 
error occurs for category c, if a unit whose true 
category idcntifieation is c, is assigned by the dedsion 
rate to Category c^* k^i, A misidentification error 
is often called an error of omission. 

298. A false identification, or fal^ alarm, or fype 
n error occurs for category c, if a unit whose true 
category identification is c*. k^i,\% assigned by the 
dedsion rule to category c,. A false idcntificaiion 
error is often called an ermr of commission, 

299. A prediction lequence^ or test sequence, or a 
^neralization sequence is a set of two sequences: (1) 
data sequence (whose corresponding true category 
identification sequence may be considered to be 
unknown to the dedsion rule) and (2) a cor- 
responding category identification sequence deter- 
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rmncd hy ih« decision nile assignment. By ttinparing 
the category identification sequence detemiincd by 
the dccbion rule asngnment with the category identi- 
fioiion sequence detcnnined by the ground truth, 
the misidcntiflcation rate and the false identification 
rate (or each category in»y be estimated. 

300. A cortfiaion matrix or coniingtncy tabte is an 
wrav of probabilities whose rows and columnR ate 
both similarly dcsignaied by cairttory label untl which 
indicates the probability of correct identiHcation for 
each categorv as well as the probability of type 1 
and type n' crroi^. The (iih. klh) element P« 

the probability that a unit has tme catcgoiy identi- 
fication d and b assigned by the deeiaion nilc to 
csiccory c*. 

301. A unii is said lo be deitcted if the decision 
rule is able io assign it as belonging only to some 
(pven subset A of caiegorics from the sci C of cal- 
cgoncs. To delect a unit docs not imply that the 
decision rule is able to identify the unit us spedflcaUy 
belonging to one particuli»r category. 

302. A unit is said to be recognized^ identified^ 
classified, categorized, or soned if the decision rule 
is aWe to assign ii lo some catcgoiy from the set of 
given categories. In some applications, there may be 
a definite distinction between recognise and identify. 
In these applications, for a unit to be recogniicd, the 
decision rule must be able to assign it to a type of 
categorv. the type having included within it many 
subcategories. For a unit to be identified, the decision 
rule mubi be able to assign it not only to a type of 
category bui also lo a subcategory of the category 
type. For example, a small area ground patch which 
iJiav \K recognized as contaming trees may be 
specifically identified as containing apple trees. 

303. A unit is said to be located if specific coor- 
dinaiei can be given for the unit's physical location. 

304. Accuracy refers to the degree of closeness an 
estimate has to the tree value of what it is csiimaiing. 

305. Precision refers to the degree of doscness an 
estimate has lo its expected value, 

306- The receiver operating characterisnc or the 
receiv^er optraung curve of a pattern classifier is a 
function of its misdctection error rote against its false 
alarm rate- 

307. The ieove-K^ut method of cvaluatmg a pat- 
tern classiftcr divides the trainixig set into L aautually 
owluwve subsets each having K patterns. The clas- 
sifier is successively trained tiding i. - 1 ofthesubscts 
9nd tested on the Lth subset. The evaluation is then 
made on the accumulated performance tests of the 
cJtperiments where in eacb experiment K patterns 
were omincd from the training sal and then used in 
the testing set . Performance estimate! obtained using 
the leave- ^'-oul method arc unbiased. However, for 
small the estimates will have high variance, 

308. The rcsuhstirution method of evaluating a pat- 
tern classifier uses the same set for training and 
testing. Performance csiimalcs obtained using the 
tcsubstitution method are always biased high. 
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